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METHOD FOR PROGRESSIVE LOSSLESS VIDEO CODING, METHOD FOR 
PROGRESSIVE LOSSLESS VIDEO DECODING, PROGRESSIVE LOSSLESS 
VIDEO CODING APPARATUS, PROGRESSIVE LOSSLESS VIDEO DECODING 
APPARATUS, PROGRESSIVE LOSSLESS VIDEO CODING PROGRAM, 
PROGRESSIVE LOSSLESS VIDEO DECODING PROGRAM, AND RECORDING 
MEDIA OF PROGRESSIVE LOSSLESS VIDEO CODING PROGRAM AND 
PROGRESSIVE LOSSLESS VIDEO DECODING PROGRAM 



TECHNICAL FIELD 

[0001] 

The present invention relates to highly efficient video coding/decoding 
technology. More specifically, it relates to progressive lossless video coding/decoding 
technology that enables lossless decoding matching the original signal, while maintaining 
compatibility of code transmitted as the base part with the H.264 standard and restricting 
the coding amount of the additional part to a minimum. 
[0002] 

Priority is claimed on Japanese Patent Application No. 2004-286412, filed on 
September 30, 2004, the content of which is incorporated herein by reference. 

BACKGROUND ART 

[0003] 

Conventional lossless or progressive video coding schemes include the schemes 
mentioned below. The lossless mode of Motion JPEG 2000 standard (see non-patent 
reference 1) and JPEG-LS (see non-patent reference 2) perform closed intra-frame 
coding since they are based on still images. 
[0004] 

The "Fidelity Range Extension (FRExt)," the second version of the H.264 
standard (see non-patent reference 3) transmits the intra-frame and the inter-frame 
prediction residual signals as-is (without orthogonal transformation and quantization). 
[0005] 
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Progressive coding schemes combined with lossy coding schemes include 
schemes that code differences between decoded images and original images (refer to 
non-patent reference 4). Such schemes use MPEG-2 in the basic information, which can 
be used even by other schemes. 
[0006] 

Moreover, there are schemes that apply Discrete Cosine Transforms (DCT) for 
transformation of coefficients to integers, expand and successively transmit the 
transformed integers to bit planes, as in the Fine Granularity Scalable (FGS) Profile 
scheme in the MPEG-4 standard (see non-patent reference 5). 
[Non-patent Reference 1] 

ISO/ IEC 15444-3: 2002 Information technology - JPEG 2000 image coding 
system - Part 3: Motion JPEG 2000 
[Non-patent Reference 2] 

ISO/ IEC 14495-1 : 1999 Information technology - Lossless and near-lossless 
coding of continuous tone still images 
[Non-patent Reference 3] 

ISO/IEC 14496-10: 2003 Information technology - Coding of audio-visual 
objects - Part 10: Advanced Video Coding 
[Non-patent Reference 4] 

Nakajima, Yashima, Kobayashi: "Study on hierarchical lossless coding based on 
MPEG-2 coding parameters," The Institute of Electronics, Information, and 
Communication Engineers General Conference, D-l 1-49, Mar. 2000. 
[Non-patent Reference 5] 

ISO/ IEC 14496-2: 2003 Information technology - Coding of audio-visual 
objects- Part 2: Visual 

DISCLOSURE OF INVENTION 

Problem to be Solved by the Invention 
[0007] 

The JPEG2000 (see non-patent reference 1) above can transmit progressively 
but it cannot perform highly efficient coding using video-specific inter-frame correlation 
because it performs intra-frame coding. Also, the above-mentioned JPEG-LS (see non- 
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patent reference 2) has a higher efficiency compared to JPEG2000, but it is limited in its 
efficiency since it performs closed intra-frame coding, and it cannot transmit 
progressively. 
[0008] 

"Fidelity Range Extension (FRExt)," the second version of the H.264 standard 
(non-patent reference 3) has the problem that it cannot transmit progressively. 
[0009] 

The technology mentioned in the non-patent reference 4 is meant for coding the 
residual in the original signal space and not for coding the residual in the orthogonal 
transformation space. Therefore, it has limitations in compression efficiency since 
coding has to be performed considering even the spaces in which the primarily original 
signals do not exist. 
[0010] 

The Fine Granularity Scalable (FGS) Profile scheme of MPEG-4 standard (see 
non-patent reference 5) had the problems mentioned below. 

* After DCT, which is real number transformation, the coefficients are transformed to 
integers; therefore, lossless coding is not possible regardless of the amount of additional 
information used; 

* If it is used as-is in H.264 standard schemes in which the coefficients after 
transformation are expanded as in equation (6) described later, the expanded part is 
added as-is to the wasted coding amount. 

[0011] 

In this way, the scheme in which video-coding efficiency was enhanced by 
performing inter-frame predictions, scalability existed, and basic information was 
compatible with the H.264 standard, had not been proposed. 
[0012] 

In the light of the problems mentioned above, the present invention has as its 
object, to enable lossless decoding while restricting the coding amount of the additional 
part to a minimum and maintaining compatibility with the H.264 standard of the code 
transmitted as the base part. 

Means for Solving the Problems 
[0013] 
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To resolve the problems mentioned above, the progressive lossless video coding 
method according to the first aspect of the present invention is a progressive lossless 
video coding method that performs video coding which allows decoding that matches an 
original signal comprising: a step that inputs a residual signal obtained by subtracting a 
prediction signal from an original signal for each block of an image signal, the prediction 
signal conforming to a predetermined lossy video coding scheme and being obtained by 
space prediction in intra-frame coding or by time prediction in inter-frame coding; a step 
that determines transform coefficients obtained by applying orthogonal transformation on 
the residual signal and quantization coefficients obtained by quantizing the transform 
coefficients based on the lossy video coding scheme; a step that identifies existential 
space of transformed coefficients established from the quantization coefficients, and 
quantization parameters and quantization methods used during quantization; a validity 
judging step that judges whether grid points in the existential space of the transform 
coefficients are valid as a result of orthogonal transformation of the residual signal; an 
enumerating step that searches, in a predetermined grid point order, grid points for which 
the judgment is valid from the grid points in the existential space of the transform 
coefficients, and enumerates the grid points thus searched; a step that assigns serial 
numbers in the order of enumeration to enumerated grid points; a step that acquires serial 
numbers of grid points matching the transform coefficients of the residual signal from the 
enumerated grid points, and a step that codes and outputs the serial numbers of the grid 
points matching the transform coefficients of the residual signal. 
[0014] 

According to the second aspect of the present invention, in the progressive 
lossless video coding method, in the enumerating step that enumerates the grid points for 
which the judgment is valid from the grid points in the existential space of the transform 
coefficients, processing of judgment on whether the grid points are valid as the result of 
the orthogonal transformation of the residual signal is omitted for grid points at which 
transform coefficients cannot take in the space by using an integer value relationship 
between the transform coefficients. 
[0015] 

According to the third aspect of the present invention, the progressive lossless 
video coding method further comprises a step that outputs information excluding values 
for which some specific transform coefficients cannot take by using an integer value 



relationship between the specific transform coefficients and coefficients which have been 
already output, instead of outputting the specific transform coefficients, wherein, in the 
enumerating step that enumerates grid points for which the judgment is valid from the 
grid points in the existential space of the transform coefficients, the grid points are 
enumerated in existential space having a reduced dimension using the transform 
coefficients output beforehand. 
[0016] 

According to the fourth aspect of the present invention, in the progressive 
lossless video coding method, the validity judging step judges validity using only bit 
operations, integer addition, and integer subtraction. 
[0017] 

According to the fifth aspect of the present invention, in the progressive lossless 
video coding method, by using the knowledge that an intersection between an existential 
range of the residual signal and an existential range of the transform coefficients becomes 
a convex polyhedron, the validity judgment is suspended halfway when the grid points to 
be judged exist outside the convex polyhedron. 
[0018] 

According to the sixth aspect of the present invention, the progressive lossless 
video coding method further comprises a step that estimates a coding amount without 
executing the enumerating step that enumerates the grid points for which the judgment is 
valid from the grid points in the existential space of the transform coefficients. 
[0019] 

The seventh aspect of the present invention is a decoding method for decoding 
coded streams coded by the progressive lossless video coding method, comprises: a step 
that executes a decoding scheme corresponding to the predetermined lossy video coding 
scheme; a step that identifies existential space of transform coefficients established from 
quantization parameters, quantization coefficients, quantization methods on a coding side, 
and, if any, already decoded coefficients; a step that decodes coefficients that need to be 
decoded; a validity judging step that judges whether a grid point in the existential space 
of the transform coefficients is valid as a result of orthogonal transformation of the 
residual signal; an enumerating step that searches grid points from the grid points in the 
existential space of the transform coefficients for which the judgment is valid in the same 
order as the order of search of the grid points during coding; a step that decodes serial 



numbers; and a step that outputs grid points having orders that are equal to the decoded 

serial numbers from enumerated grid points. 

[0020] 

A progressive lossless video coding apparatus according to the eighth aspect of 
the present invention is a lossless video coding apparatus that performs video coding 
which allows decoding that matches an original signal, comprising: a means that inputs a 
residual signal obtained by subtracting a prediction signal from an original signal for 
each block of an image signal, the prediction signal conforming to a predetermined lossy 
video coding scheme and being obtained by space prediction in intra-frame coding or by 
time prediction in inter-frame coding; a means that determines transform coefficients 
obtained by applying orthogonal transformation on the residual signal and quantization 
coefficients obtained by quantizing the transform coefficients based on the lossy video 
coding scheme; an existential space deciding means that identifies existential space of 
transformed coefficients established from the quantization coefficients, and quantization 
parameters and quantization methods used during quantization; a validity judging means 
that judges whether grid points in the existential space of the transform coefficients are 
valid as a result of the orthogonal transformation of the residual signal; an enumerating 
means that searches, in a predetermined grid point order, grid points for which the 
judgment is valid from the grid points in the existential space of the transform 
coefficients, and enumerates the grid points thus searched; a means that assigns serial 
numbers in the order of enumeration to enumerated grid points; a means that acquires 
serial numbers of grid points matching the transform coefficients of the residual signal 
from enumerated grid points, and a means that codes and outputs the serial numbers of 
the grid points matching the transform coefficients of the residual signal. 
[0021] 

The ninth aspect of the present invention is a lossless video decoding apparatus 
that decodes coded streams coded by the progressive lossless video coding apparatus, 
comprising: a means that executes a decoding scheme corresponding to the 
predetermined lossy video coding scheme; an existential space determining means that 
identifies existential space of transform coefficients established from quantization 
parameters, quantization coefficients, quantization methods on a coding side, and, if any, 
already decoded coefficients; a coefficient decoding means that decodes coefficients that 
need to be decoded; a validity judging means that judges whether a grid point in the 



existential space of the transform coefficients is valid as a result of orthogonal 
transformation of the residual signal; an enumerating means that searches grid points 
from the grid points in the existential space of the transform coefficients for which the 
judgment is valid in the same order as the order of search of grid points during coding; a 
serial number decoding means that decodes serial numbers; and an output means that 
outputs grid points having orders that are equal to the decoded serial numbers from 
enumerated grid points. 
[0022] 

The progressive lossless video coding and decoding processes mentioned above 
can be realized by computer and software programs. These programs can be recorded 
and offered in recording media readable by computers, and they can also be offered 
through a network. 
[0023] 

That is, the tenth aspect of the present invention is a progressive lossless video 
coding program for executing the progressive lossless video coding method of the 
present invention on the computer. 

The eleventh aspect of the present invention is a progressive lossless video 
decoding program for executing the progressive lossless video decoding method of the 
present invention on the computer. 

The twelfth aspect of the present invention is a recording medium for a 
progressive lossless video coding program wherein a program for executing on a 
computer the progressive lossless video coding method of the present invention is 
recorded on a recording medium that can be read by the computer. 

The thirteenth aspect of the present invention is a recording medium for a 
progressive lossless video decoding program wherein a program for executing on a 
computer the progressive lossless video decoding method of the present invention is 
recorded on a recording medium that can be read by the computer. 

Effect of the Invention 
[0024] 

According to the present invention, lossless decoding that matches the original 
signals can be performed while maintaining compatibility with the coding in the H.264 
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standard for codes transmitted as base part, and restricting the coding amount of the 

additional part to a minimum. 

[0025] 

Moreover, according to the present invention, the above processing can be 
speeded up by several trillions of times. Furthermore, the coding amount can be 
estimated without actually performing coding. As a result, the selection of prediction 
mode for reducing the coding amount can be speeded up. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0026] 

Figure 1 shows the existential range Q and ¥ of R and X respectively. 
Figure 2 is the enlarged view of the ¥ area. 

Figure 3 shows an example of the configuration of a progressive lossless video 
coding apparatus. 

Figure 4 shows an example of the configuration of a progressive lossless video 
decoding apparatus. 

Figure 5 shows an example of the configuration of a progressive lossless video 
decoding apparatus when universal variable length code is used for coding the index. 
Figure 6 shows the process flow of Example 1. 
Figure 7 shows the process flow of Example 2. 

Explanation of Reference Numerals 
[0027] 

I Progressive lossless video coding apparatus 

2, 3 Progressive lossless video decoding apparatus 

I I Initialization section 

12 Orthogonal transformation section 

13 Quantization section 

14 Existential space determination section 

15 Successive coefficients coding section 

16 Bundled coefficients coding section 

1 7 End judging section 

21 Initialization decoding section 
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22 Existential space determination section 

23 Successive coefficients decoding section 
24, 28 Bundled coefficients decoding section 

25 Ubuf [] 

26 End judging section 

27 Universal variable length decoding section 

161, 241, 281 Multiple loop starting section 

162, 242, 282 Inverse orthogonal transformation section 

163, 243, 283 Prediction signal adding section 

164, 244, 284 Internal variable updating section 

165, 245, 285 Multiple loop end judging section 
166 Serial number coding section 

246 Serial number decoding section 
247, 286 Original signal output section 

BEST MODE FOR CARRYING OUT THE INVENTION 

[0028] 

Embodiments and the Examples for carrying out the present invention are 
described here referring to the drawings. Note, however, that the present invention is not 
limited to the Embodiments and the Examples described hereunder; for instance, a 
suitable combination of these may also be included in the scope of the present invention. 
[0029] 

The orthogonal transformation of the H.264 scheme is described hereunder, on 
the premise of the explanation of the present invention. 

Orthogonal transformation of the H.264 scheme 

In the H.264 standard, after predicting the pixel values within the frame or 
between frames, orthogonal transformation of the residual and quantization of 
coefficients are performed for every small block of 4 vertical and horizontal pixels. 
[0030] 

The small block of original signals is expressed as a 4x4 matrix U, and the 
signals predicting the block in the frame or between frames are similar expressed by a 
4x4 matrix Y. Thus, the prediction residual signal (4x4 matrix R) is taken as: 
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R = U-Y (1) 
All elements of these matrices are integers. Here, each element of the residual 
signal is expressed as below. 
[0031] 



R = 



a 


b 
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f 
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o 


P . 



(2) 



[0032] 

[0033] 

Where, 
[0034] 



Orthogonal transformation is applied to this matrix as below. 



X = TRT* 



(3) 



T = 
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-1 


-1 
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-2 
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-1 



(4) 



[0035] 



[0036] 



T* expresses the transpose of the matrix T. 



Moreover, each element of X is as below. 



X = 



A B C D 

E F G H 

I J K L 

M N O P 



(5) 



[0037] 

Note that although T is an orthogonal transformation, it is not an orthonormal 
transformation. The determinant of orthonormal transformation is always 1, but the 
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determinant of T (detT) is 40. Thus, the volume of an arbitrary 1 6-dimensional area 
becomes 40 times after mapping by T. In equation (3), transformation is applied by T to 
4 rows and 4 columns of R. Thus, the coefficient X after transformation is extended and 
mapped to an extremely sparse space compared to the state before the transformation 
(residual signal R), as below. 

40 4+4 = 6,553,600,000,000 times (6) 
The orthogonal transform coefficient in the H.264 is an integer, but most of the 
grid points of the coefficient space are unsuitable as residual signals (that is, integral 
values are not obtained even after inverse transformation by equation (8) given later). 
Assuming that all grid points of the coefficient space are to be used, and the grid points 
corresponding to the original signals are coded, excess bits calculated by dividing the 
logarithm of the number to the base 2 by the number of pixels (4*4 = 16) will be needed 
per pixel. 

log2 (40 4+4 ) / 1 6 = 2.66 [bit] (7) 
Considering that the target signal is 8 bits (per color component), the increase of 
2.66 bits must hinder the practical use noticeably. 
[0038] 

In the H.264 scheme, each element of X that has been expanded considerably as 
mentioned above is roughly (in a comparatively large width) quantized, and the expanded 
part is compensated. 
[0039] 

If no quantization is performed, the residual signals are completely restored by 
the following inverse transformation 

R = r 1 X(T t y 1 (8) 

The 4x4 matrix U of original pixel values can be restored by the following 
equation. 

U = R + Y (9) 
However, in practice, when the quantized coefficients in the H.264 coding are 
subjected to inverse quantization on the decoding side, values close to the original values, 
but not exactly the same as the original values are reproduced. In this way, after the 
transmission of X, a different value X' (not equal to X) is obtained, and when it is 
subjected to inverse transformation by equation (8), becomes: 
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On the decoding side, Y can have the same value as on the coding side, but since 
R cannot be reproduced, the original pixel value U = R + Y also cannot be reproduced. 
[0040] 

Accordingly, to completely reproduce U, additional information that 
compensates the information lost in the quantization of X must be separately transmitted. 
[0041] 

[Embodiment 1] 

The present Embodiment corresponds to the first aspect of the present invention. 

The method for progressive lossless video coding according to Embodiment 1 
encodes the information lost in this quantization efficiently, as described below. 
[0042] 

For instance, the value of coefficient A in equation (5) is subjected to 
quantization and transmitted, therefore, the correct value of A before quantization is not 
known on the decoding side. Here, the quantization method on the coding side is known, 
therefore, the range that A can take is known. That is, taking the example of the 
quantization method of H.264 software JM (reference: http://bs.hhi.de/-suehring/tml/, 
"JM Reference Software Version 8.4", July 2004), the quantized value level A can be 
found, as below. 

| level A | = ( |A| * qc A + qpconst ) » qbits (10) 
Here, "»" is the right bit shift operator. The positive/negative sign of level A 
matches the positive/negative sign of A. Here, qc A is an integer determined by JM 
corresponding to the position of A and the quantization parameters; qpconst is an integer 
determined by JM corresponding to the coding mode and the quantization parameters, 
and qbits is an integer determined by JM corresponding to the quantization parameters. 
[0043] 

On the decoding side, the quantization parameters, the coding mode, and the 
quantization method can be known; therefore, levels qpconst, and qbits common to 
those on the coding side can be acquired. First, the following are determined from the 
value of level A . 

x = | level A | « qbits 

y = x + (l«qbits)- 1 

mmin = (x - qpconst + qc A - 1) / qc A 

mmax = (y - qpconst) / qc A 
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Here, "«" is the left bit shift operator, 7" is an integer division for rounding 
numbers down after the decimal point. The upper and lower limits A min and A max are 
determined as given below. 
[0044] 





-ramax 
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-mmin 


( 


if 


levels < 0 ) 




mmax 


( 


if 


levels = 0 ) 




mmax 


( 


if 


levels > 0 ) 



In this way, the following upper and lower limits that the coefficient before 
quantization can take, can be obtained. 

Lower limits A mi „, B min , C min> ... , and P min (13) 
Upper limits A max , B max , C max ,... , and P max (14) 
The ranges of these numerical values correspond to the "existential space of 
transform coefficients" of the first aspect of the present invention. 
[0045] 

By executing the 16-nested loops (corresponding to the "enumerating step" of 
the first aspect of the present invention) as given in algorithm 1 shown below based on 
the upper and lower limits, all valid items in the space after the orthogonal transformation 
can be enumerated without omission. The process below corresponds to the "validity 
judgment" of the first aspect of the present invention. 

* All elements of R are integers 

* All elements of U lie in the range of 8-bit integers [0-255] 

As a result of the validity judgment mentioned above, the total number of grid 
points enumerated can be assigned to cases, while the "serial numbers" of grid points 
matching orthogonal transform coefficients of the residual signals can be assigned to 
index. 
[0046] 

[Algorithm 1] 

1 . index<r-0 

2. cases*— 0 

3. for A<— A min to A max 
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4. for B<-B mi „ to B 

max 

5. for C-f-C m i n to C max 

6. for D^-D min to D max 

7. for E^-Emin tO Emax 

8. for F*-F min to F max 

9. for G^G min to G max 

10. for H^H min to H max 

11. for I— I min tO I ma x 

12. for J<-J min tO J max 

13. for K^K min to K max 

14. for L^-Lmin tO Lmax 

15. for M«-M mi „ to M max 

16. for N<— N min to N max 

17. for O^O min to 

18. for P^P min tO 

19. begin 

20. R^T^XCT* )-» (* Equation (8) *) 

21. if all elements of R are integers 

22. then (* A to P are valid results of orthogonal transformation of integer signals *) 

23. U<-R+Y (* Equation (9) *) 

24. if all elements of U lie in the range of 8-bit integers [0-255] 

25. then (* A to P are valid results of orthogonal transformation of residual 

signals *) 

26. if X matches the original transform coefficient 

27. then index leases 

28. endif 

29. cases <— cases + 1 

30. endif 

31. endif 

32. end 

33. index coded using the information amount corresponding to cases 
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[Embodiment 2]: Speed up using integer value relationship between transform 
coefficients 

The present Embodiment corresponds to the second aspect of the present 
invention. 

In the Embodiment 1 , the total loop frequency is extremely large because of 
executing each of the 16-nested loops in one interval. In Embodiment 2, however, the 
integer relationship existing between orthogonal transform coefficients is used. Thus, the 
loop frequency can be significantly reduced while the coding efficiency remains the same. 
[0047] 

First, by re-arranging the elements of the 4x4 matrix R from the top row to the 
bottom row sequentially, the 16-dimensional row vector fx can be obtained. 

Tx = [a, b, c, d, e, f, g, h, i, j, k, 1, m, n, o, p] (15) 

[0048] 

Equation (3) can be re-written using this 16-dimensional vector, as shown below. 
A = tt A tx t 
B = Tt B Tx 1 

P = ftp Tx 1 

Where, 

tt A = [l,l, 1,1,1,1, 1,1,1,1, 1,1, 1,1, 1,1] 
tt B = [ 2, 1, -1, -2, 2, 1, -1, -2, 2, 1, -1, -2, 2, 1, -1, -2 ] 
Ttc = [ 1,-1,-1, 1, 1,-1,-1, 1, 1,-1,-1, 1, 1,-1,-1, 1 ] 
Tt D = [ 1, -2, 2, -1, 1, -2, 2, -1, 1, -2, 2, -1, 1, -2, 2, -1 ] 
Tt E = [2, 2, 2, 2, 1, 1, 1, 1,-1,-1,-1,-1,-2, -2, -2,-2] 
Tt F = [ 4, 2, -2, -4, 2, 1, -1, -2, -2, -1, 1, 2, -4, -2, 2, 4 ] 
Tto = [ 2, -2, -2, 2, 1,-1, -1, 1, -1, 1, 1, -1, -2, 2, 2, -2 ] 
TtH = [ 2, -4, 4, -2, 1, -2, 2, -1, -1, 2, -2, 1, -2, 4, -4, 2 ] 
tti = [1,1, 1, 1, -1, -1, -1, -1, -1, -1, -1, -l, 1, 1,1,1] 
Ttj = [ 2, 1, -1, -2, -2, -1, 1, 2, -2, -1, 1, 2, 2, 1, -1, -2 ] 
tt K = [ 1,-1,-1, 1,-1, 1, 1,-1,-1, 1, 1,-1, 1,-1,-1, 1 ] 
tt L = [ 1, -2, 2, -1, -1, 2, -2, 1, -1, 2, -2, 1, 1, -2, 2, -1 ] 
Tt M = [1,1,1,1, -2, -2, -2, -2, 2, 2, 2, 2, -1, -1, -1, -1 ] 
Tt N = [ 2, 1, -1,-2, -4, -2, 2, 4, 4, 2, -2, -4, -2, -1,1,2] 



16 

Tto= [ 1, -1, -1, 1, -2, 2, 2, -2, 2, -2, -2, 2, -1, 1, 1, -1 ] 
Tt P = [ 1, -2, 2, -1, -2, 4, -4, 2, 2, -4, 4, -2, -1,2, -2, 1 ] 

[0049] 

Here, calculating ft A + T*c gives: 
Tt A + Ttc = [ 2, 0, 0, 2, 2, 0, 0, 2, 2, 0, 0, 2, 2, 0, 0, 2 ] 

= 2 [1,0, 0,1,1,0, 0,1,1,0, 0,1,1,0, 0,1] 

Therefore, 
A + C = (tt A +Ttc)tx t 

= 2 [ 1, 0, 0, 1, 1, 0, 0, 1,1,0, 0, 1, 1, 0, 0, 1 ] fx 1 

Thus, A + C is always an even number for any arbitrary integer element vector 

Tx. 

[0050] 

That is, if the value of A is known, the lower order first bit of C is seen to be the 
same as that of A, and the existential range of C is: 

C m m + ((C min + A) & 1) < C < C max - ((C max + A) & 1) (16) 
Thus, C exists sparsely in this range in the interval 2. Here, '&' is the bit AND 

operator. 

The same holds true for the following, which are in the same positional 
relationships: 

EandG 

IandK 

MandO 

[0051] 

In the vertical direction, similarly, A+I is even; therefore, if the value of A is 
known, the range of I existing in interval 2 can be known. The same holds true for the 
following, which are in the same positional relationships: 

B and J 

CandK 

D andL 

[0052] 

Next, B + (C»l) + (A»l) is always even for any arbitrary integer element 
vector |x. This is verified by varying each element of fx through 0, 1, 2, and 3 and 
confirming that it is even. That is, if the values of A and C are known, the lower order 
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first bit of B is seen to be the same as that of (C»l) + (A»l). Therefore, similar to the 
above, the existential range of B is known, in which B exists in interval 2. The same 
holds true for the following, which are in the same positional relationships and in the 
same positional relationships vertically. 

Fand(E»l) + (G»l) 

Jand(I»l) + (K»l) 

Nand(M»l) + (0»l) 
Eand(A»l) + (I»l) 
Fand(B»l) + (J»l) 
Gand(C»l) + (K»l) 
Hand(D»l) + (L»l) 

[0053] 

Next, 

2.5 ( Tt A +|tc ) + 2ftB + Tt D 

= [ 10, 0, 0, 0, 10, 0, 0, 0, 10, 0, 0, 0, 10, 0, 0, 0 ] 
= 10 [ 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0 ] 

Thus, 2B + D + 2.5 (A + C) always becomes a multiple of 10 for any arbitrary 
integer element vector |x. 
[0054] 

That is, if the values of A, B and C are known, the sum of a residue modulo 10 
of D (D mod 10) and 2.5 (A + C ) + 2B becomes 0 or 10. Therefore, the existential range 
of D can be known, and D exists in this range in the interval 10. 
[0055] 

The same holds true for those which are in the same positional relationships and 
the same vertical positional relationships, for instance, between M and A, E and I. 
[0056] 

The operator mod y, which is the residue modulo of integer y used here, is the 
same as the remainder operator '%' used in languages such as the C language for non- 
negative integer x > 0. That is, x mod y = x % y. 

With respect to the negative integer x < 0, the % operator becomes an odd 
function as shown below. 
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x%y = -((- x)%y) 
However, here, to ensure that the result does not become negative, mod y is 
taken as: x mod y = (x % y) + y (for x < 0) 
For instance, (- 1) mod 10 = 9 

[0057] 

Moreover, 

TtA + Ttc + Tti + TtK = [ 4, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 4 ] 
= 4 [ 1, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 1 ] 
Accordingly, A + C + 1 + K is always a multiple of 4 for any arbitrary integer 
element vector |x. 
[0058] 

That is, if the values of A, C, and I are known, the sum of the residue modulo 4 
of K and (A + C + I) becomes 0 or 4; therefore, the existential range of K can be known, 
and K exists in this'range in interval 4. 
[0059] 

Relationships such as given below also exist. 

[0060] 

Its - Ttj + TUs - Tto = [ 0, 4, 4, 0, 4, 4, 0, -4, 4, 0, -4, -4, 0, -4, -4, 0 ] 
= 4 [ 0, 1, 1, 0, 1, 1, 0, -1, 1, 0, -1,-1, 0, -1, -1, 0 ] 
2.5 (tt A + ttc + Tti + tt K ) + 2 (Tt E + Tto) + Tt M + Tto 

= [ 20, 0, 0, 20, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 ] 

= 20 [ 1, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 ] 
2.5 (Tt A + Ttc + Tti + Ttx) + 2 (Tt B + Ttj) + Tt D + Tt L 

= [ 20, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0 ] 

= 20 [ 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0 ] 

6.25 (Tt A + Ttc + Tti + Tt K ) + 5 (Tt B + Tt E + Tto + Ttj) + 2.5 (Tt D + T t L + TtM + Tto) + 4 Tt F 
+ 2 (Tt H + Tt N ) + Ttp 

= [ 100, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 ] 

= 100 [ 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 ] 

That is, if multiple loops are executed as shown below, the total number of loops 
can be reduced compared to looping each "for"-loop in 1 interval as follows: 
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1/(2*2*10*2*2*10*4*2*2*10*4*20*10*20*100) 
=1 /409,600,000,000 

1) Range of A looped in 1 interval 

2) Range of C looped in 2 intervals (using A) 

3) Range of B looped in 2 intervals (using A and C) 

4) Range of D looped in 10 intervals (using A, B, and C) 

5) Range of I looped in 2 intervals (using A) 

6) Range of E looped in 2 intervals (using A and I) 

7) Range of M looped in 10 intervals (using A, I, and E) 

8) Range of K looped in 4 intervals (using A, C, and I) 

9) Range of G looped in 2 intervals (using E) 

10) Range of F looped in 2 intervals (using E and G) 

1 1) Range of H looped in 10 intervals (using E, F, and G) 

12) Range of J looped in 4 intervals (using B, E, and G) 

13) Range of L lopped in 20 intervals (using A, B, C, D, I, J, and K) 

14) Range of N looped in 10 intervals (using B, F, and J) 

1 5) Range of O looped in 20 intervals (using A, C, E, G, I, K, and M) 

16) Range of P looped in 100 intervals (using A to O) 
[0061] 

More specifically, the procedure is as given in algorithm 2. Here, C' min , B f mil 
and D'min are found by using: 

f(x, y) = (- x) mod y (17) 

as given below. 
[0062] 

C min = C m in + f (C mm + A, 2) (18) 

B'min = B min + f (B min + (A»l ) + (C»l ), 2) (19) 
D min ~~ Dmin + f (Dmin + 2B + 2.5 (A + C), 1 0) (20) 
E'min to P'min are also found in a similar manner. 

[0063] 

[Algorithm 2] 

1. index*— 0 

2. cases^-0 

3. for A<— Amin to Amax (* 1 interval only here *) 
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4. for C<— C'min to Cmax Step 2 

5. for B<-B' min to B max step 2 

6. for D<-D to D max step 10 

7. for I<— I'min to I ma x Step 2 

8. for E<— E' m in to Emax step 2 

9. for M<-M' min to M max step 10 

10. for K«-K' min to Kmax step 4 

11. for G<-G 'min tO G max Step 2 

12. for F«-F' mm to F max step 2 

13. for H<-H' min to Hmax step 10 

14. for J<— J' m in tO J max Step 4 

15. for L<-L 'min tO Lmax Step 20 

16. for N^N' m in to Nmax step 10 

17. for O^-O'min tO Omax Step 20 

18. for P«-P' m in to P max step 100 

19. begin 

20. R^-T^XCT 1 )- 1 (* Equation (8) *) 

21. if all elements of R are integers 

22. then (* A-P are valid results of orthogonal transformation of integer signals 

23. U<-R+Y (* Equation (9) *) 

24. if all elements of U lie in the range of 8-bit integers [0-255] 

25. then (* A-P are valid results of orthogonal transformation of residual 



26. 



signals*) 

if X matches the original transform coefficient 



27. 



then index <— cases 



28. 



endif 



29. 



cases ceases + 1 



30. 



endif 



31. endif 



32. end 



33. index coded using an information amount corresponding to cases 



[Embodiment 3]: Reduction in the multiplicity of loops 
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The present Embodiment corresponds to the third aspect of the present invention. 
The algorithm of the Embodiment 1 and the algorithm of the Embodiment 2 use 
the 16-nested loop. In the Embodiment 3, the multiplicity of loops is reduced in order to 
achieve higher processing. Specifically, by separately transmitting the 8 coefficients 
below from the 16 A to P coefficients, the loops corresponding to these coefficients are 
eliminated. 

ABCD 

E ■ ■ ■ 

I ■ K- 

M ■ ■ " 

[0064] 

First, let us consider the transmission of coefficient A. For instance, if the 
following: 

Za ~A - A mm 

is transmitted as "additional information," then by taking: 

A — Z A + A m in 

on the decoding side, A can be restored. 
[0065] 

Since the total number of values that A can take is A max - A mm + 1 , an 
information amount required for coding Z A becomes: 
log2 (A max - A min + 1) [bit] (21) 
Since this can be shared with the decoding side, Z A can be decoded. 

[0066] 

The coefficients B to P can be transmitted in a similar manner as A, but the 
residual signal is distributed very sparsely in the space after orthogonal transformation, 
therefore, the encoded amount is wasted considerably. For instance, since loops 
associated with B are in two intervals when A and C are already known, if Z B = (B - 
B ' m in ) / 2 is transmitted, B can be restored on the decoding side by B = 2 Z B + B' min . The 
information amount required for coding Z B becomes log2 (( B max - B' min ) / 2 + 1) [bit]. 

The same holds true for C to K. Accordingly, by executing the procedures 

below: 

1) Coding the value of A by Z A 
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2) Coding is performed by Zc that has been obtained by narrowing down the range of C 
to about 1/2 (using A) 

3) Coding is performed by Z B that has been obtained by narrowing down the range of B 
to about 1/2 (using A and C) 

4) Coding is performed by Zd that has been obtained by narrowing down the range of D 
to about 1/10 (using A, B, and C) 

5) Coding is performed by Z\ that has been obtained by narrowing down the range of I to 
about 1/2 (using A) 

6) Coding is performed by Ze that has been obtained by narrowing down the range of E 
o about 1/2 (using A and I) 

7) Coding is performed by Zm that has been obtained by narrowing down the range of M 
to about 1/10 (using A, E, and I) 

8) Coding is performed by Z K that has been obtained by narrowing down the range of K 
to about 1/4 (using A, C, and I) 

, the eight coefficients given below from X are transmitted without waste. 
ABCD 
E ■ ■ ■ 
I ■ K- 
M ■ ■ » 

In this way, Zx with its narrowed down range corresponds to the "information 
excluding the values that the coefficients cannot take" of the third aspect of the present 
invention. 
[0067] 

With respect to the remaining eight coefficients: 
■ ■ ■ ■ 

•F GH 
■J - L 
•NOP 

these are expressed as a single number index and the index is transmitted, similar to 

Embodiment 1. 

[0068] 

When these are summarized, the procedure shown in algorithm 3 is obtained. 

[0069] 
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[Algorithm 3] 

1 . Encode A, C, B, D, I, E, M, and K in this order. 

2. zWex<— 0 

3. cases<—0 

4. for G*-G' min to G max step 2 

5. for F— F 

min to F max step 2 

6. for H<-H' min to H max step 10 

7. for J<~ J'min tO J max Step 4 

8. for L<— L' m jn to Lmax step 20 

9. for N<-N' min to N max step 10 

10. for 0<-0' min to Omax step 20 

11. for P<-P' m in tO P max Step 100 

12. begin 

13. R—T^XCT y l (* Equation (8) ♦) 

14. if all elements of R are integers 

15. then (* A to P are valid results of orthogonal transformation of integer signals *) 

1 6. U^-R+Y (* Equation (9) *) 

17. if all elements of U lie in the range of 8-bit integers [0-255] 

18. then (* A to P are valid results of orthogonal transformation of residual signals*) 

19. if X matches the original transform coefficient 

20. then index <— cases 

21. endif 

22. cases <— cases + 1 

23. endif 

24. endif 

25. end . 

26. index coded using an information amount corresponding to the cases 

By the procedure above, the 16-nested loops are reduced to 8-nested loops and 
the processing is speeded up. 
[0070] 

The information amount required to describe the index is: 
log2 cases [bit] (22) 
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This information can be possessed by the decoding side without additional 
information, and is information necessary for decoding the index. 
[0071] 

[Embodiment 4]: Corresponding decoding 

The present Embodiment corresponds to the seventh aspect of the present 
invention. 

Here, the embodiment of decoding corresponding to the coding of the 
Embodiment 3 is described. Even on the decoding side, by executing loops similar to 
those for coding, the values A to K and G to P become orthogonal transform coefficients 
corresponding to the original residual signals when the result of validity judgment of the 
innermost loop for (index +1) time becomes true. 
[0072] 

When coding of index is performed according to the amount of information of 
index, firstly, the amount of information of index should be known for decoding this 
index. Thus, cases should be obtained beforehand. For this purpose, loops should be 
executed similar to the procedure for coding. 
[0073] 

For instance, although additional memory is necessary, multiple loops can be 
executed only once as in algorithm 4 to prevent execution of multiple loops twice, and 
cases, index, original signals can be acquired in this order. Here, Ubuf [] is an array of 
elements of a 4x4 matrix, which is acquired dynamically or acquired in adequate quantity 
beforehand. 
[0074] 

[Algorithm 4] 

1 . Decode A, C, B, D, I, E, M, and K in this order. 

2. cases*— 0 

3. for G<-G' min to 

Gmax step 2 

4. for F<-F' mi „ to F max step 2 

5. for H<— H' mi n to H max step 10 

6. for J«-J 

'min tO Jmax Step 4 

7. for L^L 'min tO L max Step 20 

8. for N<-N' min to Nmax step 10 

9. for Oo-O'min tO Omax Step 20 
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10. for P^P'min to P max step 100 

1 1 . begin 

12. R+-T l X(T l y\* Equation (8) *) 

13. if all elements of R are integers 

14. then (* A to P are valid results of orthogonal transformation of integer signals *) 

15. U*-R+Y (* Equation (9) *) 

16. if all elements of U lie in the range of 8-bit integers [0-255] 

17. then (* A to P are valid results of orthogonal transformation of residual 

signals *) 

18. Ubuf [cases]+-U 

19. cases <— cases + 1 

20. endif 

21. endif 

22. end 

23. index decoded using the information amount corresponding to the cases 

24. U<— Ubuf [index] (* original signal values *) 

[Embodiment 5]: High speed coding amount estimation 

The present Embodiment corresponds to the sixth aspect of the present invention. 

In the H.264 scheme, various prediction modes can be selected, such as multiple 
modes or types for intra-frame predictions, and multiple block sizes for inter-frame 
predictions. Since the prediction residual signal R changes depending on the prediction 
mode, the coding amount per mode should be correctly estimated for selecting the 
optimum prediction mode considering encoding amount versus distortion. 
[0075] 

The distortion is always zero for lossless coding, thus precautions need be taken 
only to minimize the coding amount (sum of the coding amount complying with H.264 
and coding amount of additional information). 
[0076] 

When multiple loops are executed as shown in Algorithm 1, Algorithm 2, and 
Algorithm 3, naturally the correct coding amount of additional information can be 
estimated, but if a method of estimating coding amount faster exists, then it becomes 
convenient to compare multiple modes. 
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[0077] 

Embodiment 5 aims to estimate the coding amount of additional information 
without executing multiple loops. 
[0078] 

Firstly, the case when specific transform coefficients are not transmitted 
beforehand as in Embodiment 1 and Embodiment 2, is described here. The upper and 
lower limits (Equations (13) and (14)) that the coefficients before quantization can take, 
are found beforehand. Based on these limits, the volume V of the "existential space of 
transform coefficients" of the sixth aspect of the present invention is determined as 
follows: 
[0079] 

V- Y\ C*max -*min + 1) (23) 
xeA^P 

This V is considered to approximate to the number of grid points in the 
existential space. All the elements in it do not correspond to the original residual signals. 
Since the space is expanded as shown in equation (6), the following V 0 , which is 
equivalent to V divided by this expansion factor, is considered to approximate to the total 
number of grid points. 

V 0 = V/40 444 (24) 
Accordingly, the additional information coding amount per pixel 1 0 becomes: 
lo = log2 V 0 /16 
= log2(V/40 4+4 )/ 16 
= log2V/16-2.66[bit] (25) 

[0080] 

If specific transform coefficients are transmitted beforehand as in Embodiment 3, 
the information amount lj can be expressed similar to Equation (21) as below. 
[0081] 

Z l = X (( * max ~ X min)/"* + !) (26) 

Where x comprises the following coefficients. 
ABCD 
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E ■ ■ • 

I • K • 
M ■ ■ ■ 

[0082] 

Here, n x is the amount that narrows down the range mentioned earlier, and the 
values of A, ... ., M, are as follows: 

1 2 2 10 

2 - • • 
2 ■ 4 - 
10- • ■ 

A' m in = A m i ns C' m j n to M' m i n are determined as shown in equation (18). 

[0083] 

The volume Vj of the "existential space of transform coefficients" of the 
remaining eight dimensions becomes as follows: 
[0084] 

Vx = n (* max ~ * min + ^ (27) 

Here, similar to the previous case, the grid points corresponding to the original 
residual signals exist sparsely. The expansion factor of this space is obtained by dividing 
equation (6) by the product of all the n x (x e A, ... , M) as below. 
[0085] 

n 0 = 40 4+A / [~] » x = 40 8 /(l*2*2*10*2*2*4*10) 

= 1,024,000,000 (28) 
The information amount lj per pixel of the "total number of grid points" 

becomes 

l 2 = log2 (V,/no)/16 
= log2V,/16- 1.87 [bit] (29) 

[0086] 

Finally, the additional information amount per pixel becomes the sum of the 

two: 



li + h [bit] 
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(30) 



[0087] 

Using the estimated values as in equations (25) and (30), the coding amount can 
be estimated without executing the coding using multiple loops. By selecting the mode 
at which the coding amount becomes minimum based on this estimated coding amount, 
and by actually coding only for the selected mode, near-optimal lossless coding can be 
realized. 
[0088] 

[Embodiment 6]: Speeding up the validity judgment 

The present Embodiment corresponds to the fourth aspect of the present 
invention. 
[0089] 

Because T 1 is given as below, if equation (8) is calculated, floating-point 
calculations are necessary. 



(31) 
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However, if T 1 is multiplied by a factor of 20, we get: 



[0090] 



To = 20T~ l = 



5 4 5 2 

5 2-5-4 

5-2-5 4 

5-4 5-2 



(32) 



Thus, by using T 0 instead of T 1 , the value of 400 (=20*20) times the correct R 
shown below (hereinafter referred to as R400) can be obtained only by integer operations. 
[0091] 

R 4 oo = 400R = T 0 XTo t (33) 

[0092] 
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When defining the following equation, equation (33) can be resolved into the 
application of equation (34) eight times vertically and horizontally. Specifically, this 
calculation can be performed quickly by executing algorithm 5. 



s 




a 
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= T 0 


b 






u 
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V 




d 



(34) 



[0093] 

[Algorithm 5] 

1 . xo <— 5 (a + c) 

2. xi 5 (a - c) 

3. x 2 <— 4b + 2c 

4. x 3 <— 2b - 4c 

5. s<— X0 + X2 

6. t<— xi + X3 

7. u<— Xi - X3 

8. v<— xo - x 2 

Here, 5x can be obtained by shifting once and adding once as in (x « 2) + x, 
and 4b +2c can also be obtained by shifting twice and adding once as (b « 2) + (c « 1). 
Thus, no multiplication is necessary in the calculation of equation (33). 
[0094] 

Here, "all elements of R are integers," which is one of the "validity judgments" 
mentioned earlier, is equivalent to "all elements of Riooare multiples of 400." If this is 
implemented, division is necessary to confirm that the remainder after division by 400 is 
zero. However, since the redundancy that the elements are multiples of 25 has already 
been removed when making the loops, it needs only to be confirmed that they are 
multiples of 16. This is equivalent to saying that the "lower 4 bits of all elements of R400 
are all 0." This is also equivalent to saying that "the result of the bit AND operation with 
each element and 15 (1 1 1 1 in binary form) is 0," and a judgment can be made without 
division. 
[0095] 
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Now, it is necessary to correct the judgment that "all elements of U lie within the 
range of 8-bit integers [0 to 255]" as part of another "validity judgment." If equation (9) 
is multiplied on both sides by 400, we get: 

U 4 oo = 400 U = R400 + Y400 (35) 

Here, Y400 is the prediction signal Y multiplied by 400. If Y 40 o is prepared 
beforehand (if a 256-element lookup table is used, multiplication by 400 is not necessary), 
and if its sum with R400 is determined, then 400 times the original signal can be obtained. 
Since 255 * 400 = 102,000, it is sufficient to confirm that "all elements of U 400 He in the 
range [Oto 102,000]." 
[0096] 

This procedure can be summarized to arrive at a procedure similar to algorithm 

6. 

[0097] 

[Algorithm 6] 

1. index*— 0 

2. cases*— 0 

3. for A<-A min to A max (* 1 interval only here *) 

4. for C*-C' min to Cmax step 2 

5. for B«-B' mi „ to B max step 2 

6. for D<— D' min to D max step 10 

7. for I<— I'min tO I max Step 2 

8. for E<-E' min to Emax step 2 

9. for M-<— M' min to M max step 10 

10. forK^K' min to Kmax step 4 

1 1. for G«— G' m in to G max step 2 

12. for F<-F' min to F max step 2 

13. for H«-H' min to H max step 10 

14. for J<— J'mi„ tO Jmax Step 4 

15. for L<— L' m in to Lmax step 20 

16. for N<— N' m in toN max step 10 

17. for 0*-0' m in to O max step 20 

18. forP*-P' min toP max step 100 

19. begin 
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20. R400 *-T 0 XT 0 l (* Equation (33) *) 

21 . if the lower 4 bits of all elements of R400 are 0 

22. then (* A-P are valid results of orthogonal transformation of integer signals *) 

23. U400 — R400 + Y400 (* Equation (35) *) 

24. if all elements of U400 lie in the range of [0 to 1 02,000] 

25. then (* A-P are valid results of orthogonal transformation of residual signals *) 

26. if X matches the original transform coefficient 

27. then index <— cases 

28. endif 

29. cases ceases + 1 

30. endif 

31. endif 

32. end 

33. index coded using the information amount corresponding to the cases 

[Embodiment 7]: Speed-up of processing using convexity 

The present Embodiment corresponds to the fifth aspect of the present invention. 

[0098] 
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Considering the existential space of the residual signal R, if the prediction pixel 
signal at the position of the top left element a is taken as Y a , then a satisfies the following 
existential range. 

0<a + Y a <255 (36) 

-Y a <a<255-Y a (37) 
The upper and lower limits are also determined in a similar manner for b to p. 
Considering a 16-dimensional space, the existential range fi of R will be a convex 
polyhedron (hyper-rectangular solid). 
[0099] 



32 

Even in the 16-dimensional space obtained by transformation of the existential 
range of R by equation (3), the existential range after undergoing rotation and expansion 
is also a convex polyhedron. Although the transform coefficient X exists in this 
transformed space, since the upper and lower limits of each element are determined as in 
equations (13) and (14), the existential range of X is also a convex polyhedron (hyper- 
rectangular solid). Consequently, Qn¥, the intersection of £1 and also becomes a 
convex polyhedron. If these relationships are expressed in two dimensions for 
simplification, then they will be as shown in Figure 1. 
[0100] 

Figure 2 is the expanded view of the ¥ region of Figure 1 . When executing 
multiple loops in the steps enumerating the grid points, if B is varied with A = Ao as 
shown in this figure, the second validity judgment (all elements of U lie within the range 
of 8-bit integers [0 to 255]) changes from "True" to "False" in the fifth grid point (grey 
color). Since the existential range QfW is convex, "False" can be verified after the sixth 
grid point, therefore, B loop is stopped and the next B loop is re-started with A = Aj. In 
this case, the validity judgment changes from "True" to "False" at the sixth grid point 
(grey color), therefore the loop is stopped. In this way, the judgment on the part 
surrounded by the dashed line in the figure can be suspended. 
[0101] 

When the above is summarized, the procedure becomes similar to that in 
algorithm 7. If the procedure for suspending the validity judgment of all coefficients is 
shown, the indentation becomes too deep, therefore for simplification, the procedure for 
suspending the validity judgment related to 3 variables (N, O, and P) in the innermost of 
the multiple loops is shown; it is adequate to show the generality here. 
[0102] 

[Algorithm 7] 

1 . index*— 0 

2. cases*— 0 

3. for A<— A m in to A max 

4. for B<-B min to B max 

5. for C*-C min to C max 

6. for D^-D min to D max 

7. for E^-Enun tO Emax 
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8. for F«— F m j„ to F max 

9. for G-H-G min to G max 

10. forH*-H min toH max 

11. forI«-I min toI max 

12. for J«— J min to J max 

13. for K<— K,nin to Kmax 

14. for L— Lmin to Lmax 

15. for M<— M m in tO Mmax 

16. begin 

17. CheckN-^ False 

18. for N^N min to N max 

19. begin 

20. CheckO *- False 

21. for (V-O min to O max 

22. begin 

23. CheckP<- False 

24. for P— P min to P max 

25. begin 

26. R^T^CT* (* Equation (8) *) 

27. if all elements of R are integers 

28. then (* A-P are valid results of orthogonal transformation of integer signals*) 

29. U*-R + Y (* Equation (9) *) 

30. if all elements of U lie in the range of 8-bit integers [0 to 255] 

3 1 • then (* A-P are valid results of orthogonal transformation of residual 
signals *) 

32. if X matches the original transform coefficient 

33. then index *— cases 

34. endif 

35. Check N <— True 

36. Check O «- True 

37. Check P <— True 

38. cases «— cases + 1 

39. else if CheckP = True 
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40- then goto 21 (* the validity judgment changes from True to False *) 

41. endif 

42. endif 

43. end 

44. if CheckP = False and CheckO = True 

45. then goto 18 (* the validity judgment changes from True to False*) 

46. endif 

47. end 

48. if CheckP = False and CheckO = False and CheckN = True 

49. then goto 15 (* True changes to False*) 

50. endif 

51. end 

52. end 

53. index coded using the information amount corresponding to the cases 

[Embodiment 8]: Example of configuration of coding apparatus 

The present Embodiment corresponds to the eighth aspect of the present 
invention. 

The configuration of apparatus for realizing the present invention is described 
below. Figure 3 shows an example of the configuration of a progressive lossless video 
coding apparatus of the present invention. In addition to a section (not shown in Figure 
3) that calculates, for each block, the residual signal Rorig between an original image 
signal and a predicted image signal obtained by time prediction in inter-frame coding or 
space prediction in intra-frame coding based on the H.264 standard coding scheme, the 
progressive lossless video coding apparatus 1 is provided with: an initialization section 
1 1 that initializes cases and index; an orthogonal transformation section 12 that 
orthogonally transforms the residual signal Rorig; a quantization section 13 that 
quantizes the output of the orthogonal transformation section 12; an existential space 
determination section 14 that determines upper and lower limit information A min , A max , 
• Pmin, and Pmax; a successive coefficients coding section 15 that codes coefficients to 
be transmitted successively in a coded format, a bundled coefficients coding section 16 
that determines and codes index, a number that represents bundled coefficients; and an 
end judgment section 17 that judges whether all the blocks in the image have been coded. 
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[0103] 

The bundled coefficients coding section 16 is provided with: a multiple loop 
starting section 161 that enumerates combinations of all coefficients within the upper and 
lower limits of each coefficient; an inverse orthogonal transformation section 162 that 
performs inverse orthogonal transformation of a 4x4 matrix X established by coefficients 
in the existing loop and coefficients already coded and transmitted; a prediction signal 
adding section 163 that determines the sum of matrices U = R + Y; an internal variable 
updating section 164 that updates index and cases; a multiple loop end judging section 

165 that judges whether combinations of all coefficients within the upper and lower 
limits of each coefficient have been examined or not; and a serial number coding section 

166 that codes the index, 
[0104] 

The progressive lossless video coding apparatus 1 shown in Figure 3 works as 
described below. First, the initialization section 1 1 initializes the "total number of grid 
points" cases and the "serial numbers" index of grid points that match the orthogonal 
transform coefficients of residual signals, respectively to 0. 
[0105] 

Next, the orthogonal transformation section 12 applies orthogonal 
transformation to the residual signal Rorig to obtain Xorig. The quantization section 13 
quantizes this Xorig using the information on quantization parameters. From this 
quantization information, the existential space determination section 14 determines the 
information on upper and lower limits A min , A^,..., P min , and P max . 
[0106] 

Next, the successive coefficients coding section 15 codes the coefficients to be 
transmitted successively in a coded format. For instance, in case of the Embodiment 1 
mentioned above, no coefficients are coded; while in case of the Embodiment 3, eight 
coefficients, namely A, C, B, D, I, E, M, and K, are coded. 
[0107] 

Next, the bundled coefficients coding section 16 determines and codes the index 
which is a number that bundles and represents the remaining coefficients. That is, the 
multiple loop starting section 161 in the bundled coefficients coding section 16 
enumerates all the ranges that the remaining coefficients (for instance, 16 coefficients 
from A to P in case of Embodiment 1, and 8 coefficients, namely G, F, H, J, L, N, O and 
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P in case of Embodiment 3) can take within the upper and lower limits thereof. In this 
case, impossible combinations of coefficients may be bypassed using the integer value 
relationship between coefficients, as in Embodiment 2. 
[0108] 

The inverse orthogonal transformation section 162 performs inverse orthogonal 
transformation of the 4x4 matrix X established by coefficients A to P in the present loop 
and coefficients already coded and transmitted, to obtain R. If non-integer values exist in 
R, the flow advances to the process of the multiple loop end judging section 165. 
[0109] 

Next, the prediction signal adding section 163 find the sum of matrices U = R + 
Y. Here, if an element of U that does not lie in the range [0 to 255] exists, the flow 
advances to the process of the multiple loop end judging section 165. 
[0110] 

Next, if X and Xorig match, then the internal variable updating section 164 
substitutes cases for index. Moreover, 1 is added to cases. 
[0111] 

The multiple loop end judging section 165 judges whether all combinations of 
coefficients within the upper and lower limits have been examined. If they have not been 
examined, the flow returns the processing to the multiple loop starting section 161 . If the 
examination has been completed, the serial number coding section 166 codes index using 
the information amount of the cases. 
[0112] 

Next, the end judging section 1 7 judges whether all blocks in the image have 
been coded. If not, the flow moves to the processing for the next block and the 
initialization section 1 1 restarts the processing. If completed, coding ends. 
[0113] 

[If universal variable length code is used for coding the index'] 

In the present invention, the universal variable length code (Reference: Y. Itoh, 
N-M Cheung: "Universal variable length code for DCT coding," IEEE Proc. Int. Conf. 
Image Processing, Vol. 1, pp. 940-943, 2000), for instance, may be used to code the 
index without using cases. In this case, if X and Xorig match in the internal variable 
updating section 164, then universal variable length coding of the value of cases at that 
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time is performed, and the processing by the bundled coefficients coding section 16 ends 

immediately. 

[0114] 

[Embodiment 9]: Example of configuration of decoding apparatus 

The present Embodiment corresponds to the ninth aspect of the present 
invention. 

Figure 4 shows an example of the configuration of the progressive lossless video 
decoding apparatus of the present invention. The progressive lossless video decoding 
apparatus 2 is provided with: an initialization decoding section 21 that decodes 
quantization parameters and quantization coefficients, and also generates a prediction 
signal Y; an existential space determination section 22 that determines information on 
upper and lower limits A min , A max , . , P m in» and P max ; a successive coefficients decoding 
section 23 that decodes coefficients which are successively coded and transmitted; a 
bundled coefficients decoding section 24 that decodes index, a number that bundles and 
represents the coefficients; Ubuf [] 25, an array storage that stores values of U; and an 
end judging section 26 that judges whether all the blocks in the image have been decoded. 
[0115] 

The bundled coefficients decoding section 24 is provided with: a multiple loop 
starting section 241 that enumerates combinations of all coefficients within the upper and 
lower limits of each coefficient; an inverse orthogonal transformation section 242 that 
performs inverse orthogonal transformation of a 4x4 matrix X established by coefficients 
in the existing loop and coefficients already decoded; a prediction signal adding section 

243 that determines the sum of matrices U = R + Y; an internal variable updating section 

244 that stores U in the address of Ubuf [] 25 designated by the cases and updates cases; 
a multiple loop end judging section 245 that judges whether combinations of all 
coefficients have been examined within the upper and lower limits of each coefficient; a 
serial number decoding section 246 that decodes index; and an original signal output 
section 247 that outputs the value of an element of Ubuf \] 25 specified by index as the 
original image signal. 

[0116] 

The progressive lossless video decoding apparatus 2 shown in Figure 4 works as 
described below. First, the initialization decoding section 21 initializes cases, the total 
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number of grid points to 0, decodes the quantization parameters and quantization 

coefficients, and generates the prediction signal Y. 

[0117] 

Based on the quantization parameters and the quantization coefficients, the 
existential space determination section 22 finds the information on upper and lower 

limits A m in, A m ax* Pmin 3 and Pmav. 

[0118] 

Next, the successive coefficients decoding section 23 decodes the coefficients 
that have been successively coded and transmitted. For instance, in case of the 
Embodiment 1, no coefficients are decoded; while in case of the Embodiment 3, eight 
coefficients, namely A, C, B, D, I, E, M, and K are decoded in this order. 
[0119] 

Next, the bundled coefficients decoding section 24 decodes the index^ which is a 
number that bundles and represents the remaining coefficients, and performs lossless 
restoration. That is, the multiple loop starting section 241 in the bundled coefficients 
decoding section 24 enumerates all the ranges that the remaining coefficients (for 
instance, 16 coefficients from A to P in case of Embodiment 1, and 8 coefficients, 
namely G, F, H, J, L, N, O, and P in case of Embodiment 3) can take within the upper 
and lower limits thereof. 
[0120] 

In this case, impossible combinations of coefficients may be bypassed using the 
integer value relationship between coefficients, as in Embodiment 2. However, the 
procedure for bypassing impossible combinations of coefficients and enumerating is 
exactly the same as the procedure for the corresponding coding apparatus. 
[0121] 

The inverse orthogonal transformation section 242 performs inverse 
transformation of the 4x4 matrix X established by the coefficients A to P in the existing 
loop and the coefficients decoded already, to obtain R. If non-integer values exist in R, 
the flow advances to the process of the multiple loop end judging section 245. 
[0122] 

Next, the prediction signal adding section 243 find the sum of matrices U = R + 
Y. Here, if the value of an element of U that does not lie in the range [0 to 255] exists, 
the flow advances to the process of the multiple loop end judging section 245. 
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[0123] 

Next, the internal variable updating section 244 stores U in the address of Ubuf 
[] 25 specified by cases ensured beforehand and adds 1 to cases. 
[0124] 

The multiple loop end judging section 245 judges whether all combinations of 
coefficients within the upper and lower limits have been examined. If they have not been 
examined yet, the flow returns the processing to the multiple loop starting section 241 . If 
the examination has been completed, the serial number decoding section 246 decodes the 
index using the information amount corresponding to the cases. 
[0125] 

Next, the original signal output section 247 extracts the value of the Ubuf [] 25 
specified by index, and outputs it as the original image signal. 
[0126] 

Next, the end judging section 26 judges whether all blocks in the image have 
been decoded. If not, the flow moves to the process for the next block and the 
initialization decoding section 21 restarts the processing. If they have been decoded, the 
decoding ends. 
[0127] 

[Example of configuration of decoding apparatus when universal variable length code is 
used in the coding of the index] 

When universal variable length code is used for coding the index in the present 
invention, the configuration of functional blocks becomes similar to that shown in Figure 
5 on the decoding side. In the progressive lossless video decoding apparatus 3 shown in 
Figure 5, the universal variable length decoding section 27 decodes the index, the 
multiple loop end judging section 285 judges whether the number of times multiple loops 
have been executed is the same as the index, and if it is, judges end of the processing 
immediately, and outputs the value of U at that stage as the original signal. Consequently, 
the array storage such as Ubuf [] 25 shown in Figure 4 is not necessary. The operation of 
other parts is the same as in the example described in Figure 4. 



[Example 1] 
[0128] 
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Example 1 corresponding to Embodiment 3 is described here. An overview of 
the core processing in Example 1 is described below. 
[0129] 

Input: Quantization parameter, prediction signal Y, and original residual signal 

Rorig 

Process: A part of the orthogonal transform coefficients corresponding to the 
original signals is converted to compressed information, and the rest of the coefficients 
are expressed as serial numbers among those that enumerate all combinations that can 
become original signals without omission. 
[0130] 

Output: Compressed information (Z A to Z K ) that expresses a part of the 
coefficients (A, C, B, D, I, E, M, and K), and code {index) that represents one number 
summarizing the remaining coefficients (G, F, H, J, L, N, O, and P) 

Example 1 is described here referring to the process flow shown in Figure 6. 
Firstly, the quantization parameter, the prediction signal Y, and the original residual 
signal Rorig are input in step SI 01. Next, both index and cases are initialized to 0 in step 
SI 02. 
[0131] 

Next, orthogonal transformation is applied to Rorig in step SI 03 to obtain 
original transform coefficient Xorig. At the same time, the quantization coefficient 
obtained by quantizing Xorig is also determined. In step SI 04, the upper and lower 
limits of each element (A to P) of X, which is an estimated matrix of Xorig that has been 
determined from the quantization parameters and quantization coefficients obtained until 
now. Based on these, A, C, B, D, I, E, M, and K are subjected to compressive coding 
sequentially in step SI 05. 
[0132] 

Next, the flow advances the 8-nested loop for G, F, H, J, L, N, O, and P (step 
SI 06 to step SI 14). In step SI 07, R is obtained by inverse transformation of the 4x4 
matrix X formed by the present values of A to P using equation (8). 
[0133] 

In step SI 08, it is confirmed that all the elements of R are integers. If false, the 
flow moves to step SI 14; if true, the flow moves to step SI 09 to calculate U = R + Y. 
[0134] 
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Next, in step SI 10, all elements of U are checked to confirm whether they lie 
within the range of [0-255]. If false, the flow moves to step SI 14; if true, the flow moves 
to step SI 1 1 to confirm whether X is equal to the original transform coefficient Xorig. If 
this is true, the value of the present cases is stored in the variable index in step SI 12. 1 is 
added to the value of cases in step SI 13 and the flow moves to step SI 14. 
[0135] 

A check is made in step 1 14 to confirm that all the 8-nested loops have been 
completed. If false, the flow returns to step SI 06, which is the beginning of the loop. If 
true, in step SI 15, the index is coded using the information amount (equation (22)) of the 
cases (total number of grid points) already found, and the processing ends. 
[0136] 

Here, an example of the process of separately coding (step SI 05) firstly a part of 
the coefficients (eight coefficients A, C, B, D, I, E, M, and K) beforehand was shown. 
However, if this is omitted, and if step SI 06 to step SI 14 are made multiple loops of all 
16 coefficients, an example corresponding to Embodiment 1 or Embodiment 2 with 
exactly the same framework can be obtained. 

[Example 2] 
[0137] 

Example 2 corresponding to Embodiment 4 is described here. An overview of 
the core processing in Example 2 is described below. 
[0138] 

Input: Quantization parameter, prediction signal Y, and quantization coefficient 
Process: A part of the orthogonal transform coefficients (A, C, B, D, I, E, M, 
and K) corresponding to the original signals is decoded from the compressed information, 
and the rest of the coefficients (G, F, H, J, L, N, O, and P) are decoded as serial numbers 
that designate combinations in all enumerated combinations which can become original 
signals without omission. 

Output: Original image signal 

Example 2 is described here referring to the process flow shown in Figure 7. 
Firstly, cases is initialized to 0 in step S201 . Next, quantization parameters and 
quantization coefficients are decoded, and the prediction signal Y is generated in step 
S202. This information can be obtained from the H.264 basic information bit stream. 
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[0139] 

In step S203, the upper and lower limits of each coefficient (A to P) of the 
matrix X are found from the information obtained until now. Based on these limits, A, C, 
B, D, I, E, M, and K are decoded sequentially in step S204. 
[0140] 

Next, the flow advances the 8-nested loop of G, F, H, J, L, N, O, and P (step 
S205 to step S212). In step S206, R is obtained by inverse transformation of the 4^4 
matrix X formed by the present values of A to P using equation (8). 
[0141] 

In step S207, all the elements of R are checked if they are integers. If false, the 
flow moves to step S212; if true, the flow moves to step S208 to calculate U = R + Y. 
[0142] 

Next, in step S209, all elements of U are checked to confirm if they lie within 
the range of [0-255]. If this is true, the present value of U is stored in the address of the 
array Ubuf [] specified by cases in step S210, the flow moves to step S21 1 where 1 is 
added to the cases and then moves to step S212. If false, the flow moves to step S212. 
[0143] 

In step 212, a check is made to confirm that all the 8-nested loops have been 
completed. If false, the process returns to step S205, which is the beginning of the loop. 
If true, in step S213, the index is decoded using the information amount (equation (22)) 
of the cases (total number of grid points) already found, and Ubuf [index] (corresponding 
to the original signal) is output in step S214, and the process ends. 
[0144] 

In the Examples above, the example of coding index using cases was described, 
but for coding the index, universal variable length code (UVLC: Universal Variable 
Length Code) or stop code may also be used. When universal variable length code or 
stop code is used for coding index, decoding is possible even if cases on the decoding 
side is not known. In this case, the coding amount for index may have to be increased by 
slightly less than 20%. However, since there is no need to calculate the value of cases* 
the process can be suspended halfway through the multiple loops. This has the advantage 
that the time for both coding and decoding can be reduced to about half. Another 
advantage is that the array storage Ubuf □ on the decoding side is not necessary. 
[0145] 
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Embodiments and Examples of the present invention have been described above 
referring to the drawings, but these are meant only for illustrating the present invention, 
which is evidently not limited to only these Embodiments and Examples. Consequently, 
various changes such as additions, omissions, substitutions, and so on of structural 
elements may be effected to the present invention without departing from the spirit and 
scope of the present invention. 
[0146] 

For instance, in addition to the mode for realizing the apparatuses shown in 
Figures 3 to 5 by dedicated hardware, the apparatuses may include a computer system 
provided with memory, central processing unit (CPU) and so on, with a program for 
realizing processing of these apparatuses (for instance, each step given in Figures 6 to 7) 
loaded in memory and executed, so that the functions of the apparatuses are realized. 
Moreover, the program for realizing the functions mentioned above may be recorded in 
recording media that can be read by a computer, and the program recorded in the 
recording media may be read by the computer system and run by the computer. 
[0147] 

The computer system mentioned here is assumed to include an OS and hardware 
such as peripheral equipment. The recording media that can be read by a computer refers 
to portable media such as flexible disks, magneto-optical disks, ROM, CD-ROM and so 
on, and recording equipment such as hard disks integrated within the computer system. 
Items that can dynamically retain programs for a short time (transfer media or transfer 
waves) such as communication lines for transmitting the program through 
communication circuits such as telephone circuits or networks such as the Internet, and 
items that can retain programs for a fixed period of time such as volatile memory in the 
computer system that forms a client or server, are also included. The above-mentioned 
program may be meant for realizing a part of the functions mentioned above, or it may be 
a difference file (difference program) that can realize the functions by combining with 
the programs recorded already in the computer system. 
[0148] 

Furthermore, progressive lossless video coding apparatus and progressive 
lossless video decoding apparatus may be configured as described below. 

That is, the progressive lossless video coding apparatus may be provided with: a 
means for generating bit streams compliant with the H.264 standard; a means for 
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inputting a prediction signal by space prediction in intra-frame coding or by time 
prediction in inter-frame coding in the coding of each block of an image signal; a means 
for inputting a residual signal obtained by subtracting the prediction signal from the 
original signal; a means for determining transform coefficients obtained by applying 
orthogonal transformation on the residual signal based on the H.264 standard scheme and 
quantization coefficients that have quantized the transform coefficients; a means for 
identifying the existential space of transform coefficients established from quantization 
coefficients, quantization parameters and quantization methods; a validity judging means 
forjudging whether the grid points in the space are valid as the results of orthogonal 
transformation of the residual signal; an enumerating means for enumerating grid points 
for which the judgments mentioned above are valid from the grid points in the space; a 
means for sequentially assigning serial numbers starting from 0 to the enumerated grid 
points; a means for obtaining serial numbers of grid points that match the transform 
coefficients of the residual signals from the enumerated grid points; and a means for 
coding the obtained serial numbers. 
[0149] 

When enumerating grid points in the progressive lossless video coding apparatus 
mentioned above, a means may be provided for omitting the validity judging process for 
points at which transform coefficients cannot take in the space, by using integer value 
relationship between transform coefficients. 
[0150] 

The above-mentioned progressive lossless video coding apparatus may also 
include: a means for transmitting information excluding values for which some specific 
transform coefficients cannot take by using integer value relationship between the 
specific transform coefficients and already transmitted coefficients (if they exist), instead 
of transmitting the specific transform coefficients; and a means for enumerating grid 
points in existential space, the dimension of which is reduced , using transform 
coefficients transmitted beforehand. 
[0151] 

The progressive lossless video coding apparatus mentioned above, may also 
include a means for equivalently realizing the validity judgment mentioned above only 
with bit operation, integer addition, and integer subtraction. 
[0152] 
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The progressive lossless video coding apparatus mentioned above may include a 
means for suspending the above-mentioned validity judgment halfway by using the 
knowledge that the intersection of existential range of residual signals and existential 
range of transform coefficients forms a convex polyhedron. 
[0153] 

The progressive lossless video coding apparatus mentioned above may include a 
means for estimating the coding amount without enumerating the grid points by the 
above-mentioned enumerating means. 
[0154] 

The progressive lossless video decoding apparatus corresponding to the 
progressive lossless video coding apparatus mentioned above, includes: a means for 
implementing the H.264 standard decoding scheme; a means for identifying the 
existential space of transform coefficients established from quantization parameters, 
quantization coefficients, quantization methods on the coding side and from already- 
reproduced coefficients (if they exist); a means for decoding coefficients to be decoded; 
an enumerating means and a validity judging means similar to the first through third 
aspects of the present invention; a means for decoding serial numbers; and a means for 
outputting grid points, the order of which is equal to a serial number. 

INDUSTRIAL APPLICABILITY 

[0155] 

The present invention is related to progressive lossless video coding and 
decoding technology that realizes highly efficient video coding and decoding. According 
to the present invention, while maintaining compatibility with the coding in the H.264 
standard for codes transmitted as base part, lossless decoding matching the original 
signals can be performed while restricting the coding amount of the additional part to a 
minimum. Moreover, according to the present invention, processing can be speeded up 
by several trillions of times. Furthermore, according to the present invention, the coding 
amount can be estimated without actually performing the coding, and as a result, the 
prediction mode for reducing the coding amount can be selected at high speed. 



